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We report the results of a blind search for flavor-changing neutral current, lepton-flavor violat- 
ing, and lepton- number violating decays of D + , , and D° mesons (and their antiparticles) 
into modes containing muons and electrons. Using data from Fermilab charm hadroproduc- 
tion experiment E791, we examine the ir££ and K££ decay modes of D + and Df and the 
£ + £~~ decay modes of D°. No evidence for any of these decays is found. Therefore, we present 
branching-fraction upper limits at 90% confidence level for the 24 decay modes examined. 
Eight of these modes have no previously reported limits, and fourteen are reported with sig- 
nificant improvements over previously published results. 
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Les resultats d'une recherche aveugle portant sur des courants neutres de changement de saveur 
ou des violations de la conservation de la saveur ou du nombre leptonique sont presentees 
a partir de l'etude de disintegrations des mesons charmes D + , Df, et D° ainsi que leur 
antiparticules via des modes contenant soit des electrons, soit des muons. Base sur l'echantillon 
de donnees amassees par l'experience d'hadroproduction de charme E791 a Fermilab, nous 
examinons les modes de disintegration de D + et Df via n££ et Kit ainsi que D — > £ + £~ . 
Aucune evidence pour ces types de disintegration n'a ete trouvee. Nous derivons done des 
limites superieures correspondant a des intervalles de confiance de 90% pour les 24 modes 
examines. Huit de ces limites n'avaient jamais ete mesurees au prealable et quatorze autres 
representent une amelioration considerable sur les limites anterieures. 



One way to discover physics beyond the Standard Model is to search for decays that are forbidden 
or else are predicted to occur at a negligible level. If seen, such decays might require new physics such 
as the introduction of a new particle to mediate the decays. Many experiments have examined decays 
of the charge 1/3 strange and beauty quarksEl Here, we look for rare and forbidden decays involving 
the charge 2/3 charm quark. Charge 2/3 quarks may couple differently than charge 1/3 quarksEl 

We present the results of a searcbu for 24 decay modes of charmed D mesons and their antiparticles. 
These decay modes fall into three categories: 

1. FCNC - flavor-changing neutral current decays (D° — ► £ + £~ and Df dg s — > h + £ + l~); 



2. LFV - lepton-flavor violating decays (D° — ► fi^e^, Df ds \ — > /i+^e^, and Df ds ^ — > h fi 



m 



which the leptons belong to different generations and h is tt or K); 



3. LNV - lepton-number violating decays (D~fa g \ — > /i in which the leptons belong to the 

same generation but have the same sign charge). 

Decay modes belonging to (1) occur within the Standard Model via higher-order diagrams, but the 
branching fractions are at the 10 -6 to 10 -8 levelp below current sensitivity. However, if additional 
particles such as squarks or charginos exist, they could contribute additional amplitudes that would 
make these modes observable. Decays in (2) or (3) do not conserve lepton number and thus are 
forbidden. However, lepton number conservation is not required by Lorentz or gauge invariance, and a 
number of theoretical extensions to the Standard Model predict lepton-number violation!! The limits 
we present here for rare and forbidden dilepton decays of the D mesons are typically more stringent 
than those obtained from previous searches, iHlli or else are the first reported. 

The data are from Fermilab E791pi which recorded 2 x 10 10 events at up to 10 MBytes/sEJ These 
events were produced by a 500 GeV/c tt~ beam in five target foils. Track and vertex reconstruction 
were provided by 23 silicon microstrip planes^ and 45 wire chamber planes, plus two magnets. 

Electron identification (ID) was based on transverse shower shape plus the match of tracks to 
shower positions and energies in our electromagnetic calorimeter^ ID efficiency varied from 62% 
below 9 GeV to 45% above 20 GeV. The probability to mis-ID a pion as an electron was about 0.8%. 

Muon ID was obtained from two planes of scintillation counters. The first plane (5.5m x 3.0m) 
of 14 counters measured the horizontal x axis while the second plane (3.0m x 2.2m) of 16 counters 
measured the vertical y axis. The counters had 15 interaction lengths of shielding. Candidate muon 
tracks were required to pass cuts that were set using D + — ► K /i + ^ M decays from our data0 Timing 
from the y counters was used to improve the x position resolution. Counter efficiencies were measured 
using muons originating from the primary beam dump, and were found to be (99 ± 1)% for the y 
counters and (69 ±3)% for the x counters. The probability for misidentifying a pion as a muon 
decreased with momentum; from about 6% at 8 GeV /c to (1.3 ± 0.1)% above 20 GeV/c. 

After reconstruction of our 50 Terabyte data set pi events with evidence of well-separated pro- 
duction (primary) and decay (secondary) vertices were selected to separate charm candidates from 
background. Secondary and primary vertices had to be separated by more than 20 a L for D + decays 
and more than 12 a L for D° and Df decays, where a L is the calculated longitudinal resolution. The 
secondary vertex had to be separated from the closest material in the target foils by more than 5 a' , 
where a' L is the separation uncertainty. The sum of the vector momenta of the tracks from the sec- 
ondary vertex was required to pass within 40 /jm of the primary vertex. Finally, the net momentum 
of the charm candidate transverse to the line connecting the production and decay vertices had to be 
less than 300, 250, and 200 MeV/c for D°, Df, and D + candidates, respectively. These cuts and our 
CerenkovliB kaon ID cuts were the same for each search mode and for its normalization mode. 

We used a blind analysis technique. Before cuts were finalized, all events within a mass window 
AM$ around the mass of the D + , Df, or D° were masked so that the presence or absence of any 
potential signal would not bias our choice of cuts. All cuts were chosen by studying signal events 
generated by a Monte Carlo simulation program (see below) and background events from real data. 
Events within the signal windows were unmasked only after this optimization. Background events 
were chosen from a mass window AMb above and below the signal window AMg. The cuts were 



chosen to maximize the ratio N$ /vNb, where N$ and Nb are the numbers of signal and background 
events, respectively. We used asymmetric windows for the decay modes containing electrons to allow 
for the bremsstrahlung low-energy tail. The signal windows are: 

1.84 < M(D+) < 1.90 for D+ -► hfifi 1.78 < M(D+) < 1.90 GeV/c 2 for D+ hee and hpe 
1.95 < M(D+) < 1.99 for D+ -» hufx 1.91 < M(D+) < 1.99 GeV/c 2 for D+ -» hee and fyue 
1.83 < M(D°) < 1.90 for £>° -> 1.76 < Af(D°) < 1.90 GeV/c 2 for £>° -» ee and /ie 

We normalize the sensitivity of our search to topologically similar Cabibbo-favored decays. For 
the D + decays we use D + — > K^tt + tt + ; for Df we use — > 07r + ; and for D° we use 7T . 

The mass widths of our normalization modes were 10.5 MeV/c 2 for D+, 9.5 MeV/c 2 for D+, and 12 
MeV/c 2 for D°. The events within the ~ 5a window are shown in Figs. |l]a-c. The upper limit for 
each branching fraction is Bx = (Nx / -^Norm) ■ (eNorm/ex) ■ -^Norm, where Nx is the 90% CL upper 
limit on the number of decays for the rare or forbidden decay mode X, and ex is that mode's detection 
efficiency -/VNorm is the fitted number of normalization mode decays; ffNorm is the normalization mode 
detection efficiency; and -BNorm is the normalization mode branching fraction0 
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Figure 1: Top row: typical normalization charm signals. The signal region is shaded. Bottom row: invariant 
mass plots of D + candidate decays to K~fj, + fi + , K~e + e + , and K~/.i + e + , showing reflections mostly from 
misidentified D + — * K~ir + ir + decays. These modes are used to set mis-ID rate rather than upper limits The 
solid curves are normalized Monte Carlo fits. The dashed lines show the signal window. 

The ratio of detection efficiencies is given by e^s orm /ex = ^Norm/^x ' where N$^ m and iVj^ c are 
the fractions of Monte Carlo events that are reconstructed and pass final cuts, for the normalization and 
decay modes, respectively. We use Pythia/ JetsetEs as the physics generator and model the effects 
of resolution, geometry, magnetic fields, multiple scattering, interactions in the detector material, 
detector efficiencies, and the analysis cuts. The efficiencies for the normalization modes varied from 
about 0.5% to 2% and for the search modes varied from about 0.1% to 2%. 

Monte Carlo studies show that the experiment's acceptances are nearly uniform across the Dalitz 
plots, except that the dilepton ID efficiencies typically drop to near zero at the dilepton mass thresh- 
old. The efficiency typically reaches its full value at masses only a few hundred MeV/c 2 above the 
dilepton mass threshold. We use a constant weak-decay matrix element when calculating the overall 
detection efficiencies. Two exceptions to the use of the Monte Carlo simulations in determining relative 
efficiencies are made: those for Cerenkov ID when the number of kaons in the signal and normalization 
modes are different, and those for the muon ID. These efficiencies are determined from data. 

The 90% CL upper limits Nx are calculated using the method of Feldman and CousinsEj to account 
for background, and then corrected for systematic errors by the method of Cousins and HighlandE3 
In these methods, the numbers of signal events are determined by simple counting, not by a fit. All 
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Figure 2: Final event samples for the D + (rows 1-3), (rows 4-7), and D° (r 



decays. The solid curves 



represent estimated background; the dotted curves represent signal shape for a number of events equal to the 
90% CL upper limit. The dashed vertical lines are AMg boundaries. 

results are listed in Table |l| and shown in Fig. |2|. The kinematic criteria and removal of reflections 
(see below) are different for the D + ', Df , and D°. Thus, the D + and D+ rows m Fig. | with the same 
decay particles are different, and the seventh row of Fig. [2] is different from the bottom row of Fig. [I]. 

The upper limits are determined by both the number of candidate events and the expected number 
of background events within the signal region. Background that is not removed by cuts include decays 
in which hadrons (from real, fully-hadronic decay vertices) are misidentified as leptons. In the case 
where kaons are misidentified as leptons, candidates have effective masses which lie outside the signal 
windows. Most of these originate from Cabibbo-favored modes D + — > K~n + n + , Df — » K~ K + ti + , 
and D° — > K~it + . These Cabibbo-favored reflections were explicitly removed prior to cut optimization. 
There remain two sources of background in our data: hadronic decays with pions misidentified as 
leptons (A^Misffi) and "combinatoric" background (iVcmb) arising primarily from false vertices and 
partially reconstructed charm decays. After cuts were applied and the signal windows opened, the 



number of events within the window is iVobs = -Wsig + -^MisiD + A^Cmb- 

The background iVMisiD arises mainly from singly-Cabibbo-suppressed (SCS) modes. These misi- 
dentified leptons can come from hadronic shower punchthrough, decays-in-flight, and random overlaps 
of tracks. We do not attempt to establish a limit for D + — * K~t + t + modes, as they have relatively 
large feedthrough signals from copious Cabibbo-favored K~tt + tt + decays. Instead, we use the observed 
signals in K~£ + £ + channels to measure three dilepton mis- ID rates under the assumption that the ob- 
served signals (shown in Figs. |l|d-f) arise entirely from lepton mis-ID. The curve shapes are from Monte 
Carlo. The following mis-ID rates were obtained: r w = (7.3 ± 2.0) x 10" 4 , r^ e = (2.9 ± 1.3) x 10" 4 , 
and r ee = (3.4 ± 1.4) x 10~ 4 . Using these rates we estimate the numbers of misidentified candidates, 
iVjJjjsiD (f° r D + and Df) and N$ islD (f° r ^°)> i n tne S1 g na l windows as follows: N^f slD = r u ■ iVgg<g 
and ^MisiD = r u ' ^SCS> wnere -^scs an< ^ ^SCS are ^ ne numbers of SCS hadronic decay candidates 
within the signal windows. For modes in which two possible pion combinations can contribute, e.g., 
D + — > h + i^i^ , we double the rate. 

To estimate the combinatoric background iVcmb within a signal window AMg, we count events 
having masses within an adjacent background mass window AMg, and scale this number (N&m b ) by 
the relative sizes of these windows: iVcmb = (AMs/AMb) • N&m b - To be conservative in calculating 
our 90% confidence level upper limits, we take combinatoric backgrounds to be zero when no events 
are located above the mass windows. In Table [l] we present the numbers of combinatoric background, 
mis-ID background, and observed events for all 24 modes. 

Systematic errors in this analysis include: statistical errors from the fit to the normalization 
sample A^Norm; statistical errors on the numbers of Monte Carlo events for both N$^ m and N^ c ; 
uncertainties in the calculation of mis-ID background; and uncertainties in the relative efficiency 



Table 1: E791 90% confidence level (CL) branching fractions (BF) compared to previous experiments. The background 

and candidate events correspond to the signal region only. 
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for each mode, including lepton and kaon tagging. These tagging efficiency uncertainties include: 
1) the muon counter efficiencies from both Monte Carlo simulation and hardware performance; 2) 
kaon Cerenkov ID efficiency due to differences in kinematics and modeling between data and Monte 
Carlo simulated events; and 3) the fraction of signal events (based on simulations) that would remain 
outside the signal window due to bremsstrahlung tails. The larger systematic errors for the modes, 
compared to the D + and D° modes, are due to the uncertainty in the branching fraction for the Df 
normalization mode. The sums, taken in quadrature, of these systematic errors are listed in Table |l|. 

In summary, we use a blind analysis of data from Fermilab E791 to obtain upper limits on the 
dilepton branching fractions for flavor-changing neutral current, lepton-number violating, and lepton- 
family violating decays of D + , Df, and D° mesons. No evidence for any of these decays is found. The 
90% confidence level branching fraction limits shown in Table [| represent significant improvements 
over previously published results. In the future we hope to report results for 4-prong decays of the D° 
charm meson to a pair of leptons and either a neutral vector meson lj or a tttt, -kK, or KK pair. 

This research was supported by the U.S. DOE and NSF, the Brazilian Conselho Nacional de 
Desenvolvimento Cientffico e Tecnologico, CONACyT (Mexico), the Israeli Academy of Sciences and 
Humanities, and the U.S. -Israel Binational Science Foundation. 
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